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Estimating the mean of a stationary random process from the average 
of equally weighted samples taken periodically in a closed interval (0, T) 
is considered. The variance of this estimator as a function of the number 
of samples in the interval is given in the form of a modified sampling theo- 
rem. 

I. INTRODUCTION 

This paper* considers the problem, commonly encountered in detec- 
tion theory, of estimating the mean of a stationary random process from 
samples taken periodically in a closed interval (0, T). The samples are, 
in general, correlated and the estimator used is the average of equally 
weighted samples taken in the interval. Existing results are extended to 
give a clearer interpretation of the dependence of the variance on the 
number of samples. The dependence is obtained in terms of the power 
spectral density of the process in the form of a modified sampling 
theorem. 

II. THEORY 

2.1 General 

To estimate the mean value, A, of s{t) where 

s(t) = A+n(t), (1) 

the first sample is taken at t = 0, and a total of N + 1 samples is taken 
in time T.n(l) is a sample function from a wide-sense stationary random 
process with mean zero and known autocorrelation function R(t). 

* This work was supported by the U. S. Navy, Bureau of Ships under contract 
No. Nobsr-89401. 
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The estimator of A is 

A = [i/(JV + 1)] Z s(mT/N). (2) 

m=0 

For a fixed T, N is to be chosen to minimize the variance of A . 
The variance of A is given by 

<r\A) = [\/{N + 1)] t N (l - J^pL) R(mT/N). (3) 

Equation (3 ) may be found in slightly different form in the literature. ' 
It is now convenient to define a weighting function, q To {r), by 



fr.(r) = 



1-^ |r|*r. (4) 



, otherwise. 
With this definition, (3 ) may be written as 

where 5(t) is the Dirac delta function. It is more revealing to express 
the variance in terms of spectral densities; thus, we make the following 
definitions: 

i r°° 

^(«) - /at ■ in / Qkn+D /n]t(t)R(t) exp (— jwr) dT 

(AT + 1) J-» ( 6 ) 

= Q(«)®5(«), 
where 

Q( w ) = / Ar ■ i\ / Qwr+»mr(r) exp (-jW) dr 

r/sin[ w (AT+ l)/2iV]Tl 2 



iV I [w(JV + 1)/2N]T 

and >S(w) is the spectral density of n(t). 
Also define 

1 r 00 

(N + 1) -U (g) 



exp(-jcor) J^«(*-7r)*-- 
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By using Poisson's sum formula we can show that 

Now, comparing (5), (8), and (9), we observe that 

Sa) = G(0) = ^±j(m 2 -?f). (10) 

Because Q(co) is approximately zero for 

| co | _ (2t/T)[N/(N+1)], 

if £(co) is zero f or | co | _ 2x6, their convolution, F(co), will be approxi- 
mately zero for | to | _ 2ir[B + N/T(N + 1)]. From this result and 
(10) we observe that choosing 



makes 

a 2 (i) = G(O) « (N/T)F(0). (12) 

Although the restriction of (11) appears to minimize the variance of 
A, it should be observed that F(0) is also a function of N, namely 



I sin co---,;.- T 






(jv + 1) 7 - 

If 27t/jT is of the same order of magnitude as 2wB, the bandwidth of 
£(co), then (N/T)F(0) and therefore the a 2 (A) may be minimized by 
choosing the smallest value of N satisfying (11). In such cases, making 
N larger may actually increase the variance, as illustrated in the ex- 
amples. (N/T)F(0) would be independent of N if the first sample is 
taken at t = T/N rather than t = 0. Solving (11) for N yields an 
approximate rule that 

N! *BT 1 + Vl + WBn, (14) 

where N is an integer, will minimize the variance of A . It should be 
recalled that the total number of samples taken in T is N + 1 . 

The form of (9) is frequently encountered in sampling theory, where 
one sometimes thinks in terms of the original spectra, F(u)), shifted 
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by integral multiples of the sampling frequency, 2-irN/T. The Nyquist 
frequency is determined such that overlapping of the sideband spectra 
is small. This is too restrictive when one is interested in the variance, 
since then only the value of G (to) at a = is of interest. Thus, sampling 
can be done at a rate sufficient to prevent overlapping of sidebands at 
co = 0. Equation (14) may be considered as a modified sampling theorem, 
stating that, to minimize the variance, the sampling frequency, /„ , 
must satisfy 

f ^N = B i + Vl + WBT). ( 15 ) 

For large T, f s is equal to one half of the Nyquist frequency required to 
reconstruct the time function. 

2.2 Variance for Large T 

When T is sufficiently large, the Q(to) function approaches a delta- 
function, namely 

Q(u) w 2w8(u>)/(N + 1), (16) 

and 

00 

cr 2 (i) & [N/T(N + 1)] E S(m2TN/T). (17) 

If, as before, $(co) is bandlimited and 

2tN/T ^ 2t [fi + 1 (jY ^ 1} ] « 2ttB (18) 

then 

<r 2 (A)tt S(0)/T. (19) 

Notice that taking more than BT samples will not decrease the variance 
appreciably. Taking less than BT samples will increase the variance at 
a rate which depends on S(w). The dependence of the variance on N 
can be easily obtained for this limiting situation from (17). In general, 
if dS(u>)/da> ^ for co ^ 0, then the variance of A will also be a mono- 
tonically decreasing function of N for N/(N 4- 1) « 1. On the other 
hand, if the spectral density of the noise is not monotonically decreasing 
for co ^ 0, then the variance of A will have local minima for values of 
N < BT. These statements concerning mono tonicity would be true for 
all T and N if (N/T)F{0) were independent of N. 
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2.3 Limit of Continuous Sampling 

The limit of continuous sampling has been derived elsewhere 1 and is 
easily obtained from (3). The result is 

**U>c = | f' (l - 1) R(r) dr = 1 £ q T (r)R(r) dr (20) 
As T becomes large, 

.^.wfSMiMA.-^ (22) 



Thus, for large T, taking N = BT samples gives the same variance as 
sampling continuously. 

2.4 Equivalent Independent Samples 

When T is large, one can determine the number of independent 
samples required to achieve the same variance as continuous sampling. 
The variance for Ni independent samples is 

1 r 

n I S(oi)dw 

*U)m t - Wi • 

Equating this variance to the variance of (22) requires 

1 r" 

/ S(u>)du 

M. = T 

5(0) • 
Defining the effective bandwidth as 



(23) 



(24) 



1 f" 

,5- / 5(«)& 



._ 27r i- w — (25) 

5(0) 

(24) can be written as 

Ni = 2B e T. (26) 

However, the variance achieved by continuous sampling may be ob- 
tained by taking .V = BT samples in time T. Thus, 

Ni = (2B e /B) (27) 
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equates N for minimum variance to the number of independent samples 
required to achieve the same variance. 

III. EXAMPLES 

The variance of the sample mean as a function of number of samples 
(AT + 1) and length of record (T) has been computed for several spectral 
densities. 

The variance of the sample mean shown on the following figures was 
computed using (3) . 



3.1 Rectangular Spectrum 



&(») = 



fi, -2tt < ai < 2x 
lO, elsewhere. 



(28) 



Fig. 1 shows <r 2 (A ) plotted against number of samples. Each curve 
of the set represents a different length of record T. The table on the 
figure shows the relationship of the curves to the length of record. 

The most striking feature of the curves on Fig. 1 is the abrupt steps 




4 5 6 8 10 20 

NUMBER OF SAMPLES 



30 40 50 60 80 100 



Fig. 1 — Variance of the sample mean as a function of the number of samples 
and length of record for a process with rectangular spectral density. 
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in a- 2 (A) as N is increased. This behavior is predicted by (17). Equation 
(14) predicts the approximate value of N for minimum variance. These 
values of N are shown for each of the curves by a small circle. 

An interesting point to note here is that in some regions a better 
estimate of the mean is obtained when the same number of samples is 
taken for a smaller T. Also for small T, <r 2 (A) reaches a minimum and 
then increases as more samples are taken. This implies that for small 
values of T a smaller variance is obtained by taking a smaller number of 
samples (but including the end points) than would be obtained by 
continuous sampling. 



3.2 Sawtooth Spectrum 



&(«) = 



CO 

2^r 





-2tt ^ co ^ 2tt 



elsewhere. 



(29) 



This is an interesting case for two reasons. First, its spectrum is 
not monotonically decreasing. This gives rise to local minima and 
maxima in a 2 (A) as a function of N caused by the spectrum shape. 
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Fig. 2 — Variance of sample mean as a function of number of samples and 
length of record for a process with a sawtooth spectral density. 
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Second, its spectrum at a> = is 0, thus enhancing the error due to 
approximating Q (co). The results are shown in Fig. 2. 



3.3 Markoff Spectrum 



S 3 (o}) = 



+ 16 



(30) 



This is an example of a nonbandlimited spectrum. The values of 
a 2 (A ) are shown in Fig. 3. A point worth noting here is that if the band- 
width of the process was denned as the width at the one-half power 
points and the time function sampled according to (14), the value of 
a 2 (A) obtained would be larger by about a factor of 2 than the minimum 
value obtained by letting N approach infinity. 

This example is also the same one treated by Fine and Johnson 3 for 
small values of T. Curve A on Fig. 3 agrees with their results. 



IV. SUMMARY 



Theoiy has been presented which predicts the behavior of the variance 
of the sample mean of periodic samples taken from a stationary random 
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Fig. 3 — Variance of the sample mean as a function of the number of samples 
and length of record for a process with Markoff spectral density. 
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process. The variance is given in terms of the power spectrum of the 
sampled process. Three interesting results have been shown: 

(i) When BT ~S> 1, the variance of the sample mean is essentially 

minimized when BT samples are taken. 
(it) The variance of the sample mean is not necessarily monotonically 
decreasing as a function of the number of samples taken in a 
fixed record length. 
(Hi) For short record lengths, it is possible to obtain a smaller vari- 
ance with a small, finite number of samples than with continuous 
sampling. 

REFERENCES 

1. Davenport, W. B. Jr. and Root, W. L., Random Signals and Noise, McGraw-Hill 

Book Company, New York, 1958. 

2. Costas, J. P., Periodic Sampling of Stationary Time Series, MIT Technical Re- 

port No. 156, 16 May, 1950, p. 4, (11). 

3. Fine, T. and Johnson, N., On the Estimation of the Mean of a Random Process, 

Proc. IEEE, Feb., 1965, pp. 187-188. 



